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Abstract 



We consider two competing first passage percolation processes started from uniformly chosen 
subsets of a random regular graph on N vertices. The processes are allowed to spread with 
different rates, start from vertex subsets of different sizes or at different times. We obtain tight 
results regarding the sizes of the vertex sets occupied by each process, showing that in the 
generic situation one process will occupy 0(1)7V" vertices, for some < a < 1. The value of 
a is calculated in terms of the relative rates of the processes, as well as the sizes of the initial 
vertex sets and the possible time advantage of one process. 

The motivation for this work comes from the study of viral marketing on social networks. The 
described processes can be viewed as two competing products spreading through a social network 
(random regular graph) . Considering the processes which grow at different rates (corresponding 
to different attraction levels of the two products) or starting at different times (the first to market 
advantage) allows to model aspects of real competition. The results obtained can be interpreted 
as one of the two products taking the lion share of the market. We compare these results to the 
same process run on d dimensional grids where we show that in the generic situation the two 
products will have a linear fraction of the market each. 

1 Introduction 

First passage percolation is one of the most studied discrete models in probability theory. It can 
be realized as a random graph metric when edges have independent identically distributed weights. 
Often the distribution is assumed to be exponential and then the ball of a radius t (from a fixed 
vertex) is a Markov set process 1Z, in which new vertices are occupied at a rate proportional to 
the number of their neighbors already in lZ(t). Apart from the classical shape problem on infinite 
transitive graphs (see |14j). recently there was substantial interest in estimating diameter, typical 
distance, flooding times and related quantities for the process on large finite (and possibly random) 
graphs PU HUGS® El 0|. 

In a related two type Richardson model, introduced in [28J, one considers two first passage 
percolation processes, a blue and a red one, with possibly different rates, spreading through the 
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graph and capturing non-colored vertices. Each non-colored vertex becomes colored with color 
c at the rate proportional to the number of c colored neighbors (this can also be viewed as the 
Voronoi tessellation with respect to two independent first passage percolation metric). A significant 
amount of work on this model has been devoted to identifying the cases in which both colors grow 
indefinitely [29j [161 (13 El [231 EH E2]. In the current paper we are studying a version of this 
model on large random regular graphs (which are objects of independent interest [9, 36J). We are 
interested in the sizes of each colored component, while allowing the processes to start at different 
times, from sets of different sizes and spread with different rates. 

From an applied point of view, this model can be viewed to simulate spreading of two products 
(or viruses) through a social network. In recent years, diffusion processes on social networks have 
been the focus of intense study in a variety of areas. Traditionally these processes have been of 
major interest in epidemiology where they model the spread of diseases and immunization |431 HOl 
SU EQl El 151] . Much of the recent interest has resulted from applications in sociology, economics, 
and engineering [H] [H (26] [25] HSl SSI [37] [38] . 

The interpretations of the diffusion process in terms of product marketing and in terms of virus 
spread lead to some natural questions we address in this paper. What is the advantage that the 
first product (the first virus) has in terms of the initial time it can spread with no competition? 
What is the effect of one of them starting with larger initial size (initial seed sets) than the other 
one or having a larger rate (higher quality of a product)? What is the effect of the structure of the 
social network on the outcome of the competition between the two products? To answer the last 
question we compare the results for the model on large random regular graphs to the same model 
on large d dimensional tori. The first family of graphs model some (but not all) features of current 
social networks (small diameter, expansion etc.) while the second family models traditional spatial 
graph processes that are traditionally studies in epidemiology, ecology and statistical physics. We 
proceed with a formal definition of the process and a statement of our main results. 

1.1 Definition of the process 

In the model we study in this paper we have an underlying N vertex graph G. In this graph we have 
two sets of vertices, Bq and TZq. We think of £>o as a set of blue vertices and of TZo as a set of red 
vertices. Each edge with at least one end in BqUTZq has an independent exponential clock attached 
to it. Edges that have two ends in Bo U IZq have two independent exponential clocks attached to 
them, one for each end. The rate of the clocks on edges with an end in Bq is (3, and the rate of the 
clocks on edges with an end in TZq is 1. When the process begins all the clocks start ticking. For 
every n = 1, . . . , |-E(G)|, when the n-th clock goes off we look at the ends (u, v) of the edge whose 
clock went off. If u, v £ £> n -i U T^n-i then we simply define B n = B n -\ and lZ n = H n -\, and let 
the other clocks continue ticking. If only one end (w.l.o.g u) is in n _i U TZ n -i, then if u G B n -\ 
we define B n = B n -\ U {v}, lZ n = 1Z n -\, and assign all the other edges attached to v exponential 
clocks with rate f3. If u € 1Z n -i then we define B n = £> n -i> T^n = T^n-l U {v}, and assign all the 
other edges attached to v exponential clocks with rate 1. Denote B = B\e(g)\ an d TZ = TZ\e(G)\- 
Throughout the paper we denote the size of B n (JZ n ) by B n (i? n ), and the size of B (JZ) by B (R). 

In this paper we study the asymptotic sizes of B and TZ depending on how Bo and TZo were 
generated, on their initial sizes and on the rate parameter (3. Our research focuses mainly on the 
case where the underlying graph G is a random regular graph. 

The random N- vertex ci-regular graph G(N, d) is the uniform distribution over all graphs with 
iV vertices where all the degrees are exactly d (<i-regular graphs exist only for N, d such that dN 
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is even). For this model we obtain tight results regarding the asymptotic behavior of B and R, for 
two different ways of generating the sets Bq and TZq. The first, is letting Bq, TZq be two uniformly 
random sets of some predetermined sizes Bq and Ro respectively. The second, is picking a random 
set of size k, coloring it blue and letting it spread as described above (but with TZq = 0) until it 
grows to some predetermined size Bq. We then define Bo as the set of blue vertices, and TZo as a 
random set in V \ Bq. The results we obtain are for both /3 = 1 and /3 ^ 1. 

Another graph we study in this paper is the d dimensional torus. We show that when this is the 
underlying graph then even if we give the blue vertices a huge advantage (i.e., we let Bo contain a 
linear fraction of the vertices, we let TZq contain only one vertex and we let the blue vertices spread 
at a greater rate than the red vertices), with high probability the red vertices still occupy a linear 
fraction of the vertices at the end of the process. This situation is different than the situation in 
the random regular graph, where except for some special cases (described in Thru. [TT|) . one color 
almost surely occupies (1 — o(l))N vertices. 

1.2 Main results 

We now rigorously state our main results: 

Theorem 1.1. Let G = (V,E) be a random N -vertex d-regular graph and let Bq,Rq > be the 
initial sizes of Bq and TZq, and (3 > 0. Let Bq be a uniformly random set of Bq vertices, and TZq 
a uniformly random set of Rq vertices. The blue vertices spread with rate f3 and the red vertices 
spread with rate 1. Define 7 = 1 — ct% — /3(1 — 02). Then 

i) if Bq = N ai and Rq = N° 2 for some < a±, ai < 1 then there are two cases. 

— If 1 > then there exists a constant C > depending only on ai,ct2,/3,d such that with 
high probability the final number of blue vertices is B = (1 + o(l))CN ai+ P( 1 ~ a2 \ and the 
rest are red. 

~ If 1 ^ then there exists a constant C > depending only on ai,ct2,f3, d such that with 
high probability the final number of red vertices is R = (1 + o{l))C N a2+ ^ l ~ ai ^/ ^ , and the 
rest are blue. 

ii) If Bq = 60 an d Ro = To for some constants &o> r o > then 

~ If ft < 1 then with high probability the final number of blue vertices is B 
the rest are red. 

~ If P > 1 then with high probability the final number of red vertices is R = 
the rest are blue. 

Hi) If Bq = 60 f or some constant bo > 0, and Ro = N a2 for some < «2 < 1 then 

— If (3(1 — 02) < 1 then with high probability the final number of blue vertices is B = 
Q(N^^~ a2 ^) , and the rest are red. 

— If /3(1 — 02) > 1 then with high probability the final number of red vertices is R = 
Q(N a2+l IP), and the rest are blue. 



= Q(NP), and 
®{N l IP), and 
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Theorem 1.2. The conclusion in Thm. ["PI holds also if Bq and TZq are generated in the following 
way: Choose a uniformly random set B containing k vertices, for some k < Bq. B starts spreading 
with rate (3 until the (random) time r when the number of blue vertices reaches Bq. Bq is defined 
as the blue vertex set at time r. For the red vertex set, choose TZq of size Rq, uniformly at random 
from the set V \ Bq. 

Theorem 1.3. Let T(N, d) = (Z/nZ)^ for n such that N = n d , be the d-dimensional torus with N 
vertices. Choose a random vertex, color it blue, and let it spread until there are eN blue vertices for 
some < e < 1. Define Bq to be the blue set at this time. Choose a random uncolored vertex and 
define TZq to be this single vertex. The blue and red vertices continue to spread, the blue vertices 
with rate (3 > 1 and the red vertices with rate 1. Then with high probability, at the end of the process 
both colors occupy Q(N) vertices. 

In Sec. [4] we prove Thm. [4~T1 about a new urn model that may be of independent interest. This 
theorem is used in the proofs of the theorems above. 

1.3 Remarks and follow up work 

We note that the results of all the theorems above cannot hold if the sets Bq and TZq are arbitrary. 
Consider for example the case where Bq is the ball of radius r in the graph around a vertex v and 
TZq consists of all vertices at distance exactly r + 1 from v. While the set TZq is not much bigger 
than Bq - clearly the remaining vertices will all become red. 

The fact that the results do not hold for arbitrary sets raise various game theoretic questions. 
For example, consider a game where player B has to choose the set Bq and player R has to choose 
the set TZq . Suppose player B can choose up to N ai initial vertices and player R can choose up 
to N a2 initial vertices. What are the Nash Equilibrea of this game? Are the payoffs in the Nash 
Equilibrea close to the payoffs obtained if the two players place the initial sets at random? Similar 
game theoretic questions may be asked if players alternate in placing the elements of Bq and TZq. 

As far as we know this game was first denned by Bharathi, Kempe and Salek in [7J. Their 
paper provides an approximation algorithm for the best response and shows that the social price 
of competition is at most 2 but does not analyze the utilities of each of the players in a Nash 
Equilibrea. A different direction of future study is extending the result in the current paper to 
more realistic models of social networks and marketing. In particular it would be interesting 
to study the same question on preferential attachment random graphs and other more realistic 
models of social networks. We expect that for such graphs, game theoretic consideration can play 
an important role due to the different degrees and connectivity of different vertices. 

1.4 Related work 

As mentioned earlier, diffusion and growth processes have been studied intensely in the past few 
years in relation to many areas such as sociology, economics and engineering. Among the models 
studied are stochastic cellular automata (see, for example [48J, [26J, [25]), the voter model which was 
first introduced by Clifford and Sudbury in [13] and has been much studied since in, for example, 
[33] . [TO] . [i~9] . the contact process (see, for example, [27]), the stochastic Ising model (see [23], [TT]). 
and the influence model (see [1]). 

Recently, a strong motivation for analyzing diffusion processes has emanated from the study 
of viral marketing strategies in data mining (see, for example, [18], [35], [37], [38] )• m this model 
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one takes into account the "network value" of potential customers, that is, it seeks to target a set 
of individuals whose influence on the social network through word-of-mouth effects is high. For a 
given diffusion process, we define the influence maximization problem. For each initial set of active 
nodes S, we define a(S) to be the expected size of the set of active nodes at the end of the process. 
In the influence maximization problem, we aim to find a set S of fixed size that maximizes o~(S). 
In attempts to find a set of influential individuals, heuristic approaches such as picking individuals 
of high degree or picking individuals with short average distance to the rest of the network have 
been commonly used, typically with no theoretic guarantees (see [37]). In [37] it was shown that 
the influence maximization problem is NP-hard to approximate within a factor of 1 — | + e for 
all e > 0. On the other hand, in |38j it was shown that under the assumption that the function 
a is submodular, for every e > it is possible to find a set S of fixed size that is a (1 — - — e)- 
approximation of the maximum in random polynomial time. In it was proven that the function 
a is indeed submodular. 

As mentioned earlier the paper [7J defines the competitive influence maximization problem on 
general graphs. We believe that an interesting research direction is to show that for random d- 
regular graphs, the payoffs of the two players at each Nash Equilibrea are essentially the same as 
the payoff obtained by playing according to random strategies. 

1.5 Acknowledgments 

E.M. is supported by DMS 0548249 (CAREER) award, by DOD ONR grant N000141110140, by 
ISF grant 1300/08 and by a Minerva Grant. 

2 The random d-regular graph 

When studying d-regular graphs it is often useful to consider the configuration model. The con- 
figuration model was introduced by Bollobas in [8]. This model is used to construct a uniform 
random d-regular graph on ./V vertices. In this model we view each vertex of the graph as a set of 
d half-edges. We then pick a uniform perfect matching on these dN half-edges, and contract each 
d-tuple of half-edges back to a single vertex. It is shown in [8] that with probability that tends 

to e 4 as n —> oo, this process yields a simple d-regular graph. Moreover, conditioning on the 
event that the graph is simple, it is uniformly distributed among all simple d-regular graphs on N 
vertices. 

The uniform perfect matching can be picked by picking its edges sequentially, therefore we 
can simulate our model by the following process: We start with dN half-edges. Each half-edge 
can be in one of four states: uncolored, blue, red or explored. In the initial state we have a set 
Xq of Xq blue half-edges, a set 3^o of Yq red half-edges and a set Zq of Zq uncolored half-edges. 
The number of explored half-edges is dN — Xq — Yq — Zq. In step n, we randomly pick a half- 
edge e n from X n -\ U y n -i, where half-edges in X n -\ have weight j3 and half-edges in 3V-1 have 
weight 1. We change the status of e n to explored. We then uniformly pick another half-edge g n 
from X n —\ U y n —i U %n—l \ {e n }- If <?n is uncolored, we change its status to be explored, and 
change the status of d — 1 of the remaining uncolored half-edges to the same color that e n was 
before its status became explored. If g n is either blue or red, we just change its status to explored. 
We denote the size of X n (y n ) by X n (Y n ). The process ends when there are no more blue or 
red half-edges. If we have k\ independent rate j3 exponential random variables I±, . . . , i^, and 
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k 2 independent rate 1 exponential random variables I^+i, ■ ■ ■ , Iki+k-u then the random variable 
J = argmin{ii, . . . , Ik 1 +k 2 } is distributed among 1, . . . , k% + k 2 the same way as the half-edges e n 
is distributed when = k\ and Y n -\ = k 2 . Therefore, conditioned on the graph being simple, 

the process described here corresponds to the discrete competing infection process on a random 
regular graph with independent exponential rate f3 random variables on edges with a blue end and 
exponential rate 1 random variables on edges with a red end. However, at the end of this process 
there are no more blue or red half-edges, and since the quantity that we are interested in is the 
number of blue vertices at the end of the process, we need to keep track of the number of times the 
edges e n and g n were picked blue and uncolored respectively. We will denote M = Xq + Yq + Zq. 

In the text we also need some results on the finite Polya urns. A Polya urn is an urn containing 
balls of up to k different colors. The urn evolves according to the following Markov process. At 
each time n > 1, one ball is drawn at random from the urn, and its color is observed. If the color of 
the ball is i, then for each j = 1, . . . , k we place A^ balls of color j in the urn. Generally speaking, 
Aij can be positive or negative, or even random. 

Our result concerns only urns containing two colors - red and blue, so from now on we assume 
that k = 2. An urn scheme is usually represented by its replacement matrix 

A= (A n A l2 
V A 2 i A 22 

the rows of which are indexed by the color of the ball picked, and the columns are indexed by the 
color of the balls added. We denote the number of balls of each color at step n by S n and Z n . To 
learn more about different types of Polya urn models, see, for example |42j . 

To relevance of the urn models is revealed if we observe that the the process (X n + Y n — 1, Z n ) 
is exactly the Polya urn process with the replacement matrix 



A 



-2 
d-2 -d 



and 



The following is then a simple corollary of Theorem 14.11 

Corollary 2.1. Consider the process started with Xq blue and Yq red half- edges and Zq = M — 
Xq — Yq uncolored half-edges. Then for any e > we have that the events 

{ | Z„(l-t/Ai)^ - l| * «, *- H < - < (M - M'-/« log M)/2, } 

{\ (M-2n)-"z!(I-2n/Myn- ** «" ° * " < M ' 2 } 

have probabilities converging to 1, uniformly in Zq, as M — > oo. 

2.1 Proofs 

Thm. 11.11 and Thm. 11.21 both follow from the next theorem. 

Theorem 2.2. Let (Lm) be a sequence converging to oo, and assume that Xq A Yq > Lm and 
Zq > M/Lm- Then for any e > asymptotically almost surely (as M — > oo) we have 
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and 

R — Rq 



N-Rq-Bq 



(l±o(l)) 



where (ftp: (0,1) oo is a one-to-one function defined as <p(s) = ^ pj/p-i) ■ I n particular there 
are constants c and C such that asymptotically almost surely (as M —> oo) 



Convergence in all limits depends only on the values of (3, d and the sequence (Lm)- 

In order to prove Thm.[2]2j we define the following random process that will be used throughout 
the proofs. 

Kn = — R — • (4) 

y^(l-2n/M)(l-/3)/2 
The proof of Thm. 12.21 is based on the following lemma. 

Lemma 2.3. Let (3 be any positive real number. Let {Lm) be a sequence of positive numbers 

(i+W 4 

converging to oo and such that lim^ LmM~^ = 0, for any 7 > 0. Assume that L M P < Xq < Yq. 
Define uq as the largest integer such that 

M (l-/3)/2 R \ 2/(1+0) 

Then for any e > there is a sequence of numbers T]m converging to zero and a constant C such 
that with probability of at least 1 — t]m both of the following holds 

i) \K u /Kq — 1| < e for all < n < no, 

l+p i+JL 

ii) X n < CLjJ for all n > no in the case Kq < M^ 1- ^" 2 , and Y n < CL^f for all n > no in 

the case K Q >M^~^/ 2 . 



Remark 2.1. The choice of the exponent K ^' in the lower bound for Xq is just a technical 
condition. Actually given Xq one can always decrease the value of Lm so that the inequality in the 

<1+B) 4 /I3 2 (l+B) 4 /0 2 

statement holds. Nevertheless the assumption that Yq > L M and Xq > L M implies 

that 

lO^/^m-p < Ko < ML tf+fWf> 

and 

M-2n < 47 2(1+/3)3//3 M V L^+^^M. (5) 
In particular we know that 1 — 2uq/M is converging to 0, a fact which will be useful in our proofs. 

The proof of Lemma 12.31 is based on the following lemma and its corollary. 
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Lemma 2.4. Let < e < 1/2. For a positive real number c assume that the condition 



<c(M -2kf-W 2 (l-^(l-2k/Mf 2 - 1 ) 1 ^ (6) 



is satisfied for k = and define the stopping time r as f/ie smallest positive integer k for which ([6]) 
is no£ satisfied. Then there exists a sequence (5m) converging to and depending only on M , and 
a constant C depending only on f3, d and c such that for any positive integer n 

P(|*W - *o| > eKo, for some < k < n) < - — ^— ^- + _) + §M , (7) 
whenever 

Corollary 2.5. Let < e < 1/2. Assume that for a positive real number Cq and an integer n the 
inequality 

is satisfied for < k < n. Then there exists a sequence (5 m) converging to and depending only 
on M, and a constant C, depending on j3, d and Co, such that 

c ( m( 1 -^/ 2 1 \ 

F(\K k - K \ > eK , for some < k < n) < - 2 ( - _ + ^) + S M , (9) 



xM-2n X + Y < 
Proof. Define stopping time r as the smallest integer k such that 

/Vi ' > 2C (M - 2k)^' 2 ( 1 - - 2fc/M) d / 2 - lX * 



Af(i-j8)/2 uv ; V M 

Applying Lemma 12.41 we conclude that the event 

\K kAT - K \ < sK , for all < k < n, (10) 

has probability of at least 

C / M^-P)' 2 ±\_x 
1 e 2 V (M — 2n)( l +W 2 K + xj M ' 

for an appropriately chosen constant C. Since t < n implies K T > 2Kq, on the event in (|10p 
we have that r > n. Thus in the event in (|10p we can replace Kk^ T by which completes the 
proof. □ 

In order to prove Lemma we first prove two lemmas. The first is a general lemma bounding 
the conditional expectation and variance of the differences in a general random process. 
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Lemma 2.6. Let (K n ) n >o be a positive process such that Kq is a constant, and p n and r n positive 
real numbers defined for n >0, such that 

\E(K n+ i - K n \F n )\ < p n K n , and E((K n+1 - K n ) 2 |J" n ) < r n K n . 

Consider the process Io = Kq, I n = K n — X^fe=o ^{Kk+i ~ ^k\J~k)- Then process I n is a martingale 
and for every positive integer n we have 

n—l n—l 

\K n -I n \ < ^ 

PkQk+l, 

„_iJ fc; and E((J n - I ) 2 ) <K ^2 

k=0 k=0 

where q^k = Yl%=eO- f or & — ^ an< ^ Qk,k-l = 1; f or a ^ k > 0. 

Proof. It is trivial to check that the process I n is a martingale. Furthermore it can be shown by 
induction that for every k < n 

n n 

qk,n - 1 = ^pigi+i.n = y~]peqk,e-i- (11) 

i=k i=k 

Using the first inequality in the statement we have that 

n-l 

\K n -I n \<Y,PkK k . (12) 

fc=0 

In particular we have 

n— 1 n—l n—l 

K n - I n < ^PkK k = ^PkiKk - h) + y~]pkh- (13) 
fc=0 fc=0 fc=0 

Using fp~3|) inductively we can show that K n — I n < ^fc=o a n,klk whenever the sequence {a n ^)o<k<n 
satisfies a n ,n-i = Pn-i and a n ^k = Y^i=k+iP(- a (-,k + Pk- Using (fTTI) it is easy to check that a ni fc = 
Pkqk+i,n-i satisfies these conditions. Thus we have 

n-l 

K n < In + y^Pfcgfc+l,n-l4- (14) 
fe=0 

Plugging this back into (fT2j) and using (jXTJ) we get 

n— 2 n—l n—l 

\K n ~ I n \ < p n -\In-\ + ^Pkfa- + P^fc+M-lVfc = ^P*9jfc+l,n-l4> 

fc=0 £=fc+l A:=0 

which proves the first claim. 

Note that ([II]) and (JUll imply that 



n-l 



E(-fTn) < (l + y^Pfcgfc+l,n-ljlo = go.n-l-^O- (15) 



fe=0 
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Thus the condition in the statement implies that 

E((K n+1 - K n ) 2 ) < r n E(K n ) < r n g ,n-i^o- 
It is easy to check that E((I n+ i — I n ) 2 \F n ) < K((K n+ i — K n ) 2 \F n ) which then yields 

n— 1 n— 1 

E((I n - /o) 2 ) = J]E((J fc+ i - / fc ) 2 ) < K 2 r *9o,fc-i. 

fc=0 k=0 

This concludes the proof. □ 

The second lemma we prove in order to prove Lemma 12.41 bounds the conditional expectation 
and variance of K n — K n _\ where K n is defined in @. 

Lemma 2.7. For the process K n as defined in Q), there exists a constant C > depending on {3 
and d, such that for all integers n, on the event that Y n > 2d we have both 

CK 

\E(K n+1 - K n \F n )\ < " (16) 

±n\A-n ~r In) 

and 

CK 

E((K n+ i - K n ) 2 \F n ) < — f-, — — . (17) 



Proof. Throughout the proof we assume that M — 2n > Y n > 2d. To prove (|16|) we calculate 

(l - ^J^) {1 ~ m tPX n + Y n )(M -2n- l)E(K n+1 \T n ) = 

Xn + d ~ 2 pX n {M -2n-X n - Y n ) + -^L_ y w (M - 2n - X n - Y n ) 

+ ^^/3x n (x n - 1) + ( ^ w _~^ (i + P)x n Y n + ^^ y n (y„ - 1). (is) 

It can be easily verified that 



1 t^-) (/3X n +y„)(M-2n-l)^ n = »(j3X n +Y n )(l-——) (M-2n-l) 

= ^(/3X n + y n )(M - 2n - 2 + /3 + 0((M - 2n)" 1 )), (19) 

where the absolute value of the term 0((M— 2n)~ 1 ) is bounded by a constant multiple of [M— 2n)~ 1 . 
To prove (| 16f) it is enough to show that the absolute value of the difference of the terms in (|18p 
and (|19p is bounded by 

CX n (M-2n) 
^ n 

for some constant C. First note that, since X n + Y n < M — 2n, the expression 

X n Y-P(pX n + Y n )(M - 2U)- 1 
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is bounded by (|20p . for some C > 0. Thus we can disregard the term 0((M — 2n) _1 ) in (|19p . 

By Taylor expansion we know that for any compact interval containing 1 there is a constant C\ 
such that for all t in this interval 



1-Pt 



1 



< 



+ - (i + t)/3 



(actually by a slightly more careful argument one can argue that C\ does not depend on the 
interval). Now fix any k > —2 and choose t = kY~ and a constant Ci to obtain 



1 



KfV Yj {Y n + kf 



< 



dk 2 



{Y n + kfY 2 



For k = d — 2 this in particular implies that 

P{d - 2) \ X n Y n {M -2n-X n -Y n 



X n Yl-\M-2n-X n -Y n )(\ 



Y 



(Y n + d- 2) 



< 



C 2 X n {M-2n) 



i n 



for a constant C 2 = (d — 2) 2 C\. Therefore we can replace the term ^ y _j^_ 2 )ff Y n (M — 2n — X n — Y n ) 

on the right hand side of ([IS]) by X n Yn (M — 2n — X n — Y n )(Y n — f3(d — 2)). Arguing similarly we 
see that we can replace the terms ,y (1 + /3)X n Y n and -^3^pY n (Y n — 1) on the right hand side 

of (USD by + /3)X n (y n + p) and ^%(F n - l)(Y n + 2/3) respectively. Therefore it is enough to 

prove 

(M - 2n - X n - Y n ) ( Xn + d f} ~ 2 pX n + ^(Y n - (3(d - 2)) - ^(/3X n + Y n ) 

Y n Y n Y n 

+ ^l(3X n (X n - 1) + ^=9^(1 + P)Xn{Y n + /3) + - l)(Y n + 2/3) 

%/3x„ + y n )(x n + y n - 2 + /3) < CX " (M " 2n) 



yP 
1 n 



1 n 



for a large enough constant C. Expanding the expressions in the left hand side above we see that 
it is equal to /3(/3 + l)X n Y n 13 . This proves the claim. 

Now we prove ()17j) . First note that it is enough to prove that 



CK 2 

E((K n+1 - K n ) 2 \F n ) < 



X n Y n 



(21) 



Analyzing all the cases we see that the value of — K n \ is 

X n + d — 2 X n 



Yfi{l - (2n + 2)/M)( 1 -«/ 2 Y%(\ - 2n/M)( 1 -?)/ 2 

X n X n 



.X„ M — In 



1 



(Y n + d - 2)0(1 - (2n + 2)/M)( 1 -/ ? )/ 2 Y i{\ - 2n/M)( 1 ~/ 3 )/ 2 



<C 2 K n — + 



K M — 2n 



X n — 2 



X n 



y£{1 - (2n + 2)/M)( 1 -«/ 2 yf (1 - 2n/M)( 1 -/ 3 )/ 2 



+ 



1 



M - 2n, 



11 



X n — 1 X n 



(Y n - 1)0(1 - (2n + 2)/M)(i-/ ? )/ 2 y,f (i _ 2n/M)(i-/ ? )/ 2 



X n y n M-2n/' 



or 



(y n - 2)^(1 - (2n + 2)/M)(i-«/ 2 F,f (l _ 2n/M)( 1 ~0)/ 2 
with probabilities 

/3X n (M-2n-X n -K n ) y n (M - 2n - X n - y n ) /?X n (X 



K M — 2n 



(pX n + Y n )(M - 2n - 1) ' (/3X n + F„)(M - 2n - 1) ' (/3X n + F n )(M - 2n - 1) ' 

(i + /3)x n y n ^(^n-i) 



(/3X n + F n )(M - 2n - 1) ' (/3X„ + Y n )(M - 2n - 1) ' 

respectively. Here Ci, C2, C3, C4 and C5 are constants depending only on /3 and <£ Therefore for 
a large constant Co we have 

A n 1 J^i 



E((* n+1 - ^V.) < ^(^^ + ^.Ix^y-, + 



,(M-2n) 2 X n y n (/3X n + Y n ) 
which, together with the fact X n Y n < (M — 2n) 2 , yields . 



□ 

We now go back to proving Lemma 12.41 
Proof of Lemma \2.4\ We begin by showing that for any Co > we can choose C so that ([8]) implies 

V MJ\ Ml M) J ~ Me y ' 

for all < k < n. Since the function <j){t) = t — t d ^ 2 Zo/M is concave on [0, 1] the minimum of the 
left hand side in (1221) is either 



0(1 - 2n/M) > (1 - 2n/M) - (1 - 2n/M) d / 2 , or 0(1) = (M — Z )/M = (X + Fo)/Af. 

Clearly both of these values are bounded from below by the right hand side of (|22|) when the 
constant C is chosen to be large enough. 
Now define a as the first time k that 

X k + Y k < (!-§(!- 2fc/M) d / 2 ~ 1 ) or y < 2d, 

and define the process K' k = K khTh(J . Since a and r are stopping times with respect to the filtration 
J-jt, the process K' k is adapted to this filtration. 

Next we show that there is a positive constant c\ such that for all k < a A r we have 

Y k > ci(M - 2fc) (l - ^(1 - 2fc/M) d / 2 ~ 1 ). (23) 
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Assume, for the sake of contradiction, that for some k < a A r we have 

Y k < d(M - 2fc) (l " §(1 " 2fc/M) d / 2 - 1 ) . 

Then since k < t we have 

X fc < if (M - 2fc)( 1 -' 3 )/ 2 c(M - 2A ; )( 1 -^ 2 (l - §(1 - 2fc/M) d / 2 - 1 ) 1 ^ 
< ccf (M - 2ife)(l - ^(1 - 2A:/M) d / 2 - 1 ). 

Since k < a we have X fc + Yjfe > (l - fa(l - 2k/M) d / 2 ~ 1 ) which implies ccf + ci > 1/2. When 



2 ^ M 

c\ is small enough we obtain a contradiction and prove (|23p . Lemma 12.71 now implies that for all 
< k < n 

\E(K' k+1 - K' k \T k )\ < ^ -2 , (24) 

(M - 2k) 2 (l - fa(l - 2k/M) d / 2 -A 

and 

n ,2 dM^/ 2 K' , , 

E(^ +1 - ^| J- fc ) 2 < i * — - (25) 

(M - 2fc)( 3 +/ ? )/ 2 M - §(1 - 2k/M) d / 2 -A 
for some constant Ci depending only on /3, d and c. Define 

Ci 



Pk 



(M - 2A;) 2 (l - |a(l - 2k/M) d / 2 ~ 1 
First we bound X^fc=o^fc by a multiple of e. To this end observe that for all < t < 1 

f d/2-l < ^ + 1)/2 _ (26) 



Next calculate 



n— 1 „ n—1 



V Cl /v^ 1 M 2 

^ M2 ^ti(l- 2k/M) 2 ( 1 - f (1 - 2/fc/M)^/2-i N ) 2 + ( X ° + y o 



Ci / Z" 1 dt 2M 
<7^[ — 1 72 + 7^7^7v> • ( 2 7) 



2M 



l-2n/M ft (l _ Zo t d/2~l\ ( X + Yq 



M 



Here we use the fact that t i— > (t — \t d / 2 ) 2 is a convex function. To estimate the above integral 
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we use ([26]) to obtain 

- 1 dt r 1 ' 2 dt r 1 dt 



r - ,+/ 

J(l-2n/M)Al/2 +2 (a Zn+d/2-A J II 



l-2n/M t 2 (l _ ^*d/2-l) J{l-2n/M)M/2 f 2 (l _ J V 2 t 2 (l - f^/ 2 " 1 



Z 1 / 2 dt A f 1 dt 

< 77 —77^777 T77+4 



(1 _ 2 d/2+l)2 J {1 _ 2n/M)M/2 t 2 J 1/2 ^ _ ^ + z± {1 _ ^ 



C 2 M C 2 M f 1 ds 
< — h " 



M — In ' Z Ji-z /m s 2 



< C 2 M | C 2 M 



M — 2n M — Zq 

for some constant C 2 depending only on f3, d and c. For the above calculations we need to assume 
that Zq > 0, but note that the upper bound in the last line also holds for Zq = 0. Combining this 
with (|27|) and ([8]) yields Ylk=oPk — for a large enough constant C. Defining q^j = Y\i = k0-+Pi) 
as in Lemma 12.61 we have for a\ll<k<£<n — 1 

g*,/ < e E fe=o Pfc < e £/3 < §. (28) 

Now define the martingale Jo = ^cu ^& = K'k ~ Yli=o ^(^e+i ~ ^-el^t) as m Lemma HT61 which 
together with (|28p implies 

K-4|<-5>i*. ( 29 ) 



2 



Lemma 12.61 and (|25|) now yield 
3Ci/ 



E((/ n - Jo) 2 ) < 



2 



in-l j^(l-/3)/2 x \ 



^ib=l (M - 2k)^+P)/ 2 (l - fa (l - 2k/M 



3Ci/ Z" 1 eft 3CiJ . . 

" AMP J x _ 2n/M t(3+m f 1 _ f^/2-lV +/3 2(Xq + Y )^- 



The second inequality above follows from the fact that the function 

^ t ) = t~^y 2 (i-^t d / 2 - i y 1 ^ 

is either decreasing on [0, 1] or decreasing on an interval (0, to) an d increasing on (to, 1) for some 
< to < 1- This is clear from the calculation of the first derivative 

4/(t) = t-^+ 5 )/ 2 (l - |£^-2)/2)- ( ^ +2) f( p + 3 + (d-2)(P + l) ^ t(d _ 2)/2 + 3) \ 
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The integral in (|30p can be estimated like the one in fj27[) : 



dt . „i j/o, i a Z^ 2 fit 



< (i-2 l - d ' 2 )- l -P [ 
J(: 



h-ZnjM t (3+/3)/2^ _ |o £<i/2-l^ J (l-2n/A/)Al/2 t( 3+/3 )/ 2 

, 0(3+^/2 Z 1 * < r f / M Nd+W2 MT 1 _ds\ 

A/2 (! _ § + - *))^ - 4 - 2 J Z A_ Xo/M ^ J 

,r,f „ .^((- M 



(M - 2n)( 1 +/ ? )/2 (3Z q \\M-Zq 

where C4 is a constant depending only on f3 and d. To bound the last term on the last line above 
observe that for all < t < 1 we have (1 - t) p > 1 - t for j3 < 1 and (1 - tf > 1 - /3t for /3 > 1, 
which yields ((1 - t)~P - I)*" 1 < (1 A /3)(1 — i)"^, for all < t < 1. This applied to t = Z /M and 
combined with (|30p and Doob's maximal inequality imply 

F(|J fe - J 1 > ^Jo, for some < k < n) 



2e 2 X M/ 3 \ v (M-2n)( 1 +/ ? )/2 v ^VM-Z / ^ e 2 X (X + y ) 1+/? 

„ C 5 / M^-A/ 2 _1_ 
~ e 2 \{M- 2n)( 1 +P)/ 2 K + X J' 

Again for all the above calculations we need Zq > 0, but one can observe that the upper bound in 
the last line holds even if Zq = 0. If |J& — Iq\ < |Jq, for all < k < n, then (f29j) and the inequality 
Y2=oPk < e/3 imply 

|/4 - JT | < |/4 - J fe | + |J fe - J | < |(l + |Vo| + §4) < ei^o- 



Thus we have 

P(|^ - K | > sK , for some < k < n) < -± ( ^ _ + ^ 



Define 1 — 5a/ to be the probability that 

X k + Y k > - (M - 2k - Z (l - 2k/ M 

holds for all < k < n. By Theorem 14.11 we have that limj\,f->oo $M = 0. Since Ki = K k ^ T for 
k < a A n it is enough to show that P(cr < r A n) < 5m- To this end simply observe that on the 
event above, inequality (1231) and a < r A n imply 

Cl (M - 2k) (l - ^(1 - 2A;/M) d / 2 - 1 ) < y fe < 2d + 2, 

for A; = a — 1. However, by (|22p and the fact that e < 1/2, this is impossible for C large enough in 
KHJ) (recall that the value of ci depended only on c and /?). □ 
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Remark 2.2. A more careful analysis of the process K n would allow one to replace Doob's maximal 
inequality with Freedman's inequality (see f22f). and obtain exponential bound in the statement of 
Lemma \2.4\ However the bound above suffices to our purposes and, to avoid even more tedious 
analysis, we use Doob's maximal inequality. 

Remark 2.3. Starting in the proof of Lemma \2.3\ and further we will use the following simple 
fact. Let L n be any process adapted to a filtration T n . Assume that for any e we have a sequence of 
events (£lM,e) of events such that P(Ojv/, e ) ~ ^ 1 as M — > oo and such that on the event &M,e we have 
PM( n ) — e < ^(Ln+i — L n G A|.F n ) < pm(ji) + e - Then the number of indices 1 < n < N(M) — > oo 
such that L n+ \ — L n G A is on £Im,e stochastically bounded from above (below) by a sum of N(M) 
independent Bernoulli random variables with parameters PM^n) + e (pAi(n) — e). In particular, if 
N(M) — > oo then by Hoeffding's inequality (see \30ij). the number of such indices is equal to l + o(l) 

times lim M ^oo Yju=1 P( n ) ■ 

We are now ready to prove Lemma 12.31 

Proof of Lemma \2.3l Throughout the proof we assume that M is sufficiently large for the estimates 
to hold. We can assume e < 1/2 and r\u > C'L^e -1 , for any constant C (at different stages in 
the proof we choose convenient values for C). Since we can also assume that t)m < 1 (otherwise 
there is nothing to prove), we can assume that 

C 

e>j— (31) 

We start by defining the function f(t) = \fi — Zot^ d ~^' 2 /M. Recalling Theorem 14.11 we know 
that for any e > there is a sequence {8m) converging to such that with probability of at least 
1 — 5m we have that for every < n < 4f — 1 

^ j^n + Y n _ X n + Y n ^ (32) 

~ £ ~ M - 2n - Z (l - 2n/M) d / 2 ~ f(l - 2n/M) y / M(M - 2n) ~ £ ' [ ' 

Using the fact that X n + Y n = M — 2n — Z n the above inequalities can be rewritten as 

K 1 M\ MJ ~ M-2n~ K ' M\ MJ 



which in turn implies that 



1 M-2n\ (M-2n) j , . , 

(1 " £) 77 2 +^-1 - {1 + £) (33) 

1 _ Zo.( 1 _ 2 ("+fc) \ ' 



M \ M J 

whenever M — 2n — 2k > 1. Furthermore ()32|) also implies that for every < n < uq 

X n + Y n > L M /3 . (34) 

To check (33]), by (|33J) it is enough to check that <j){t) > ^ffi for 1 - 2n /M < t < 1, where 
(j)(t) = t — t d l 2 Zq/M . By the concavity of (f) and the fact that M — 2uq > Lm it is enough to check 
the lower bound for t = Lm/M and t = 1 for which the claim is obvious. The fact that (|33p and 
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(fM|) hold with probability at least 1 — 5m, where (5m) is a sequence converging to 0, enables us to 
assume these inequalities to hold throughout the proof. 

First we present the bound for the event in i) for the simplest case when (3=1. Because Xq < Yq 
we have Kq < 1 and in this case no is the largest integer with the property that M — 2uq > Lm/Kq. 
By Corollary 12.51 applied with Cq = 1 we have that with probability at least 

i C ( 1 1 \ r ^ i 2C 

l -A(M-2n )K, + X-J- 6M - 1 -^ I - hU 

we have 

\K k - K \ < eK , for all < k < no, 

which proves the claim for i) when = 1. 

Next we analyze the probability of the event in i) for j3 7^ 1. We start by showing that for any 
constant c > 1 there exists < d < 1 such that 

-/(l - 2k/M) < k M < c/(l - 2k/M) ^X k AY k > d(X k + Y k ). (35) 
If X k < c'(X k + Y k ) then Y k > (1 - d)(X k + Y k ) and 

Kl'M _ ( 1 < c'Vd-« Xk + Y k 



M \yP ) \/M (M - 2k) ^ (1 - c/yV(i-/5) V /M(M - 2fc) ! 



where the inequality in ^ is < for /3 < 1 and > for /3 > 1. Using f|32[) to bound the term 
(X k + Yfc)(M(M — 2fc)) _1//2 we obtain a contradiction with the left hand side of (135D for c' such 
that c'(l — c') _/3 < (c/ (1 — e)) _ l 1_/3 l , which yields X k > c'(X k + Y k ). In the same way one can show 
that Y k > d(X k + Yfc) for an appropriately chosen d . 

Now fix numbers < C2 < 1 and c\ > 2. We show that when f3 < 1 

^1/(1-/3) V 1 V 

= /(l), (36) 

and when {3 > 1 

An—>^P- = /( 1 )- ( 37 ) 

To prove (j36j) simply observe that it is equivalent to XoYp < (Xo + yo) 1- ^ and to 

X n ( Yq 

< 



X + Y \X + Y 

which, because of Xq < Yq surely holds for f3 < 1. Inequality ([37| is similarly equivalent to 

X Q a if Y n \P 



X + Y 1 \X + Y C 

which again holds, by the assumption that c\ > 2 and Xq < Yq. 

Note that / is a concave nonnegative function on [0, 1] and /(0) = 0. By (|36h if j3 < 1 there 
is a unique point < t<i < 1 such that ffe) = C2-Kq 1 /M. If P > 1 then in the case when 
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max[ 0j i] / > ciKq^ 1 ^ /M denote by t 2 the smallest element in / 1 (c2-fCg ^ /M) and by t\ the 

largest element in / -1 (ci1!lq /M). Define n\ as the largest integer such that M — 2ri\ > Mt\, 
and n 2 the largest integer such that M — 2ra 2 > t 2 M. Furthermore, define n\ = ri\ A uq and 
n 2 = n 2 A n . 

Next we prove that 

c 2 Kl /{l ' P) /M < /(l - 2n,/M) < dR^ 1 '® /M, (38) 

whenever n-i < n , for i = 1,2. Since ci — c 2 > 1 we only need to prove that \f'(t)\ < i^Q 1 ^' 
whenever 

M-2n -2 , K 1 '^ K 1 '^ , , 

t> , and c 2 ^- <f(t)< Cl -Q— . 39 

M M M 

Since M - 2n > L M the condition t > (M - 2n - 2)/M implies f > for M large enough. To 
finish the argument for ([38]) check that \ f'(t)\ < 2{d-2)f(t)/t for all t > 0. Now for all t satisfying 
(pi) this yields 

4(d-2)c 1 K 1/(1 - /3) 



The right hand side above is clearly less that Kq^ 1 , for M large enough, which is what we 
wanted to prove. 

We separate the analysis into three cases: 

a) p > 1 and max [0 ,i] / < ci-KJ^ 1- ^ /M , 

b) P > 1 and max [Q)1] / > ciif 1/(1_/3) / M , 

c) /3 < 1. 

To summarize, in case a) we have 

/(l - 2fc/Af) < ciK 1/(1_/3) / M > for < fc < Af/2 - 1, (40) 



in case b) 

/(l - 2k/M) { 



< ciK 1/(1_/3) /M, for < fc < ni, 

> c 2 K 1/(1_/3) / M > for n i < k < "2, if ni < Wo, ( 41 ) 

< ciK 1/(1_/3) / M > for "2 < fe < - 1, 11 n 2 < n , 



and in the case c) 



m-2kiM){ ^ c * K \tl ,M - forOS * s "- 

1 < cii^o W /M, for n 2 <k< M/2 - 1, if n 2 < n . 



(42) 



J ^ m < c{~\M - 2k)^(l - §(1 - 2k/M)^f- P . (43) 



For the case a) note that (1401) can be rewritten as 
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Because M — 2uq > L u and (f3Tj) we can apply Corollary 12.51 to get that the event that | K k — Kq \ < 
eKq for < k < riQ has probability at least 

C ( M^-^l 2 \\ C ( 1 1 \ 



e 2 V(M-2n )( 1 +«/ 2 K e 3 V^jH/O/a Lm/ 

The inequality above follows from the definition of no- This suffices for part i) in the case a). 

Next we assume that we are under the assumptions of case b). From the first inequality in (|4ip 
we obtain that (|43p holds for < k < Bi. Because M — 2m > M — 2uq we can apply Corollary 12.51 
like in the case a) and conclude that the event that \K k — Kq\ < |-K"o holds for all < k < n\, has 
probability of at least 

9C/ m( 1_/3 )/ 2 1 \ r 9C/ 1 1 
■ . ._ 1 8™ > 1 



1 " T 2 " l(M-2n 1 )(^)/2 Ko + JT ) " 5M " 1 " ^ + L^)~ 

Now if n\ = no we are done with the analysis of the event in i) in the case b). 

Otherwise assume that \K k — Kq\ < |-Ko holds for all < k < ri\ indeed, and note that ([38]) 
implies that 

' - -/(I - 2nx/M) < ^i— _ < ii— ^ /(I - 2m/M), (44) 



Ci v M c 2 

which then by (|35p and (|34p implies that both X ni and 1^ are at least c'Lm for some constant d . 
Define M' = M — 2n x , X' k = X ni+k , Y k ' = Y ni+k , Z' k = Z ni+k and 

Y' 

K- 



X; 1//3 (l-2A:/M / )( 1 - 1 //3)/2 

It is easy to check that in fact 

Similarly to (|43p . the second inequality in (|4ip implies that for ri\<k <n2 
K " > 4~\M - 2kf-W 2 ( 1 - ^(1 - 2k/M) d ' 2 -^ 



M (l-/3)/2 - 2 V > V M 

Combined with the inequality -fT ni > (1 — e)Kq, 

K m > (1 - E^Mt^lM - 2(m + Jfe))^/ 2 (l - §(1 - 2(na + ty/M)*'^ 1 ) 1 ' 1 * , 

for < k < — n\. Raising the above inequality to the power of — 1//3 and using ([33]) and 
we obtain 
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for all < k < n 2 — n\. By Corollary 12.51 we have that the event \K' k — K' \ < ^^K' , for all 
< k < ri2 — Tlx, is °f probability at least 

4/3+3(7 , M Hi-i/p)/2 x 

V(M'-2(n 2 -n 1 ))( 1 + 1 //3)/2^ + yj 

^ , ^C7/ (l + g )V^ , 1 , . 

> 1 TTs i=s -0L 



1 ( 7TT, — ^TTTi /m/o ^, + T77 ) ~ <W' 

e (M — 2n 2 ) ^ M w Jni 

> ((I + ^^m W +(c'Lm)- 1 )-Sl m , (47) 

where we used the fact that n 2 > no, the definition of no and the lower bound Y„ 1 > c'Lm- Then 
this event can be rewritten as 



K ni 



< 7^3, for all < k < n 2 - ni, 



which, using the fact that e < 1/2 easily implies that 

\K ni+k - K ni | < ~K ni , for all < k < n 2 - «i, 

and 

- K | < \K k -K ni \ + \K ni - K Q \ < |(l + ~^K Q + |iT < yi^o, for all m < fc < n 2 . (48) 
If n 2 = no we are done. 

Otherwise, assume that the event in (|48[) holds and observe that (|44[) holds when ni is replaced 
by n 2 . Thus again we have that X ri2 > c'Lm- 

Define M" = M — 2n 2 , X£ = X n2+k , Y£ = Y n2+k , Z» = Z„ 2+fc and 

X" /M"\(l-/3)/2 



M 



Following the argument that lead to (|46[) , and using the third inequality in (|41|) we can deduce that 
< (1 + _ e f-P c {-\ M " - 2k)^' 2 (l - H(l - 2k/M") d / 2 -^ 1 ' 



M //(l-/3)/2 - v M J 1 \ l \ M 

By Corollary 12.51 we have that with probability at least 

16C / M'^-fl/ 2 _L_\ _ 

£ 2 v( M "-2(n -n 2 ))( 1 +/ 3 )/ 2 K ' + X 'J ^" 

16C / M^-M 2 1 \ 

" e2 V-. 2 )(M-2n )^ + ^ ^ 

>1 16C 



e 2 



((i-^r^t^v^-/))-^. 



the event 



— Kq I > jifo) fo r some < < no — n 2 
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occurs. After a glance at the definition of K'l we proceed as in the previous step and finish the 
analysis of event in i) in the case b). 

The case c) is handled in the same way. The first inequality in ([42 p . inequality f|31[) . the fact 
that M — 2hq > Lm and Corollary 12.51 imply that the event \K k — Kq\ < eKq/3, for < k < n^, 
has probability at least 

1 9C ( M^PV 2 h 9C ( 1 1\ 

1 " ~& l(M-2n 2 )W)% + X~ )~ dM - 1 ~^ + L^)~ 

This finishes the proof if n 2 = no- Otherwise, observe that (j44p holds and thus Y„ 2 > d Lm- Then 
define X' k = X n2+k , Y> = Y n2+k , Z' k = Z n2+k , M' = M - 2n 2 and 

XL _ K -i/P(M\^ 



The second inequality in (|42p and (|32[) now imply 

Now we can apply Corollary 12.51 and conclude that with probability at least 

4/ ? + 1 C / m , ( 1 ~ 1 //3)/2 1 v 

1 l(M-2n )( 1+1 //3)/2^ + " 6m ' 

e v (M-2n ) ^ M ^ CjLm/ 

4^(7/ (1 + ^ 1 x 
> 1 n — I — h — — I - oL M , 



e 2 V m • c>L M < 

M 

we have that \K' k — K' \ < e2~ l3 ~ 1 K' for all < k < uq — n2- Using the analysis similar to the case 
b) we see that this event implies \K n2+k — Kq\ < sKq, for < k < uq — n<i- This finishes the proof 
of part i). 

Now we proceed with the proof of part ii). When Kq < M^~^/ 2 , the inequality Y no < M — 2uq 
implies 

K no >X n M 1 - m (M-2n )-^y 2 , 

which, by the definition of uq and the fact that K no < (1 + z)Ko, yields X no < (1 + e)L M +/3 ^ 2 . 
When K > M^^l 2 then the inequality X no < M - 2n implies 

K no < MM/ 2 (M - 2n )^/ 2 Y-f, 



which, by the definition of uq and the fact that K no > (1 — e)Kq, yields Y no < (1 — e) l ^ L 



1+1 

2/3 



M 



If K Q < M^-^l 2 denote by U the process X and r = ±±£ an d if Kq > M^V 2 denote by U 

f. (if K = M^-^l 2 do either^ 

largest integers such that 



the process Y and r = (if Kq = M^ 1 ^l 2 do either). Furthermore denote by n' and n" the 



/Ll,\ 2 / d / 1 \2/d 

M - 2n > M ] , and M — 2n" > Ml 



Zq J \LmZq 
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If no > n' then by Theorem 14.11 i) we know that with probability converging to 1 as M tends to 

infinity we have that Z no < 2L T M . For the constant C from Theorem 14. H i) we have L M > , 
for M large enough, and thus we can apply the theorem. The obvious inequality U n < U no + Z nQ , 
for n > uq finishes the argument in this case. 

Otherwise we assume that uq < n' . We finish the proof by showing that we have no new vertices 
with the color of type U after the time no, that is that Uk+i < Uk, for k > uq. To this end denote 

Ui = {Uk+i <U k :n <k< n'}, U 2 = {U k+1 < U k : ri < k < n"}, U 3 = {U k+1 < U k : n" < k}. 

Since with high probability Z k is bounded by a constant multiple of Zq(1 — 2k/M) d / 2 , for k < nf, 
by Remark 12. 3\ the probability of the event Ui can be estimated as 



ru ) > TT (i - c 2 u M z Q (\-2kiM)^ 

CT \ (M -2k- Z {l-2k/M) d / 2 )(M -2k) 



>1 c 2 ^ Ll I Z (l-2k/M) d / 2 

l_2-d/2+i ^ (M-2k) 2 

k=no 

where we used that fact that Z < M and M — 2k < M/2, for k > n , which follows from ([5]). It 
suffices to prove that the above sum converges to 0. To estimate it calculate 

!MH f h-lt)'" 2 - 2 < 3^ r*"- WM t ^ dt < — ^ — L T M (— ~ 2 "° + 2 Y ,2 -\ (49) 
M M> ~ M Jl-Mn'+D/M - d-2 M \ M ) ,l ' 

where the first inequality follows by monotonicity of the function 1 1— > t d l 2 ~ 2 . From ([5|) it is easy to 
see that the last term converges to (the only thing to check is that (d/2— 1)(1 — 2(l+/3) 3 //3)+r < 
and {d/2 - 1)(1 - 2(1 + /3) 3 //3 2 ) + r < 0). 

Next we bound the probability of U2. Using the inequality 

M M l ~ 2 / d , . 

M — 2n > —yj-y^ > 72/d~-> (50) 
z o M M 

we obtain M — 2n" > 2Lm, for M large enough and, since with probability converging to 1 we 
have Z n < 2L T M , for n > n' 



^ >- n 1 - ( M-»)gf-»-L M ) ) 2 1 - 2csiS e 

fc=n' fc=n' 



2/fc) 2 



r2r T 2r+2/d 

> l - 4c, =M > 1 - 4cs=^ 

" 3 M - 2n" - 2 - 3 M 1 " 2 / d " 

The right hand side clearly converges to 1 which finishes the analysis of the event U2. 

By Theorem 14.11 i) we have Z k = for k > n" with probability converging to 1. On this event 
we surely have U k < U n n, for all k > n" . Combined with the fact that the probabilities of the 
events Ui and U2 converge to 1, PCU3) also converges to 1, as M tends to infinity. □ 
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The second component in the proof of Thm. 12.21 is the following lemma which gives to give us 
estimates for the function (b defined in the theorem. 

Lemma 2.8. For f3 ^ 1 define the function (b: (0,1) — > M + as 4>p(t) = ^T^j/^x) ■ Then the 
function (ftp is one-to-one and onto and there are constants c\ < c 2 such that the inverse function 
4>p 1 : M+ -> (0, 1) satisfies 

djV^-i Al) <^ l (s) < (c 2S ^-i) Al. 

Proof. For (3 > 1 the function (ftp is decreasing and (ftp(l) = and lim^o t f/(i%) = 1- Therefore 

(ftp 1 is decreasing with ^^(O) = 1 and lim^oo ^jjp^l = 1- This proves the claim for (3 > 1. For 

f3 < 1 the function (ftp is increasing with (f)(0) = 0, lim^o t ff(i%) = 1 an d lim^i </>/3(i) = oo. This 

implies that (ftp 1 is also increasing and ^^(O) = 0, lim^o ji/i-i = 1 an d fi m s->oo (ftp 1 ^) = 1; which 
is enough to deduce the claim in the case (3 < 1. □ 

Remark 2.4. TVoie £/iai the replacing the roles of processes X and Y and setting X to have rate 
1 and Y to have the rate 1//3 in Lemma \2.3\ causes the process K n to become K n and the value 
of uq and the exponents on Lm in part ii) to remain unchanged. Therefore if both Xq and Yq are 
bounded from below by an appropriate power of Lm we do not need to assume that Xq < Yq for 
Lemma \2.3\ to hold. 

We are now ready to prove Thm. 12.21 

Proof of Thm. \2.2\ Throughout the proof we assume that the sequence (Lm) grows slowly enough, 
so that it satisfies the assumptions in Lemma 12.31 and so that, similarly to Remark 12.11 we can 
conclude that L K M M~P < K < ML^f and 1 - 2n /M < L^f for k > appropriate for our 
calculations. 

Define n\ as the largest integer such that M — 2n± > M(ZqLm)~ 2 • By the assumptions it 
follows that eL M d MZ 2 ^ d converges to oo and thus we can apply Theorem 14.11 to conclude that 
for any < n < n± we have 



Z v wy V M) 

Also define m = no A n\. 

First we prove all the results with R replaced by R m . Then we show that (R — R m )/ZQ is small 
and also small compared to M 1 ^^ 1 K^ 1 ^ , which by Z^/d = N — Rq — Bq allows us to replace R m 
with R. 

By Lemma 12.31 for any e > asymptotically almost surely we have 

Y n , , Y n \/3 (M -2n\ (1-^/2 , . q , 

1- v " = (l±o(l))( v ^ ) Kq[ - ) (Xn + Ynf- 1 . 



X n + Y n v v "\ Xn + Y n J U V M 

Combined with Theorem 14. II this gives 

1 — r„ K\ 
' (l±e) 



r ™ M 1 -' 3 (l-2n/M)( 1 -/ 3 )/ 2 (l-§(l-2n/M) d / 2 - 1 ) 1 P 
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for < n < m. For (3 = 1 this yields 



r n = (l±o(l)) 



1 



1 + K { 



o 



(l±o(l)) 



Yn 



X + Y 



for < n < m. 



Define the function ipp: (0, 1) — > K by ipp{t) = (1 — t)t~@ and observe that the derivative of <pp 
is bounded from below. Then the derivative of the inverse function ip^ is bounded from above, 
which gives that asymptotically almost surely 



\ 



yM 1 -^! - 2n/M)( 1 "/ 3 )/ 2 f 1 - §(1 - 2n/M) d / 2 - 1 J J 



1-/3 



and 



r n = (1 ± e)*f (MK^-V ((1 - 2n/M) 1/2 ~ g(l ~ 2n/M)^) ) , 



for < n < m. 

At the n-th step the conditional probability that in the n + 1-th step we add a new red vertex 
is equal to 



vl ± o(l))r r . 



X n + Y n M -2n-l v ~ w/ '"M-2n' 
for M large enough. By Remark 12.31 for (3 = 1 thus we have 



\R m -Ro\ = (l±o(l))J2 



Y ° Z °(l-2n/M) d / 2 - 1 ^(l±o(l)) Y ° Z ° 



n=0 



X + Y M 



(lie) 



X() i lb 2 7i_2m/M 
*b ^0 



x + y d 



(l - (1 - 2m/M) d / 2 ) . 



(1 - 2m/M) d / 2 converges to we can disregard this term, which proves ([1]). 
For (3 7^ 1 we proceed as follows. By Remark 12.31 asymptotically almost surely we have 

m 

\R m - R \ = (1 i o(l)) £ ^ (Af^/^ 1 ) ((1 - - f (1 - ^ d -^)) f (1 - § )^ 1 . 

n=0 

The sum on the right hand side above converges to the integral 

f£ 2m/M ^ 1 (^ w " I, G i/2 -§» w - i,/2 ))^- 1 * 

which proves ([2]), except for the different lower bound in the integral. Note that for the convergence 
of Riemann sums to the corresponding integral we used the piecewise convexity and concavity of 
subintegral functions. 
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Before giving the argument for the correction of the lower bound we prove ([3]). For f3 = 1 the 
inequalities in ([3]) are easy to check, so we focus on the case (3 ^ 1. By Lemma 12.81 we have 



y ( l-2m/M)W Kl ll> V M ' -N-Ro-Bo 

J(l-2m/M) d /* Kq' 1 \ M J 

The trivial inequality R — Rq < N — R — B yields 1 for the upper bound in © • For the second 
part of the upper bound in ([3]), it is enough to prove that the integral 



- t i/ d _ zo t (d-i) /d y/e 1 dt (51) 



'(l-2m/M) d / 2 v M 

is bounded from above by a constant depending on (3 and d only. This follows from the inequalities 

f l/d _ t (d-l)/d < f l/d _ ZO t (dr-l)/d < t l/d 

~ M ' 

and the fact that t \- > is integrable on (0, 1). Actually the inequalities above, together 

with the fact that (1 — 2m/M) d ^ 2 < 1/2 for M large enough, imply that the minimum of the 

function (^t 1 ^ — is bounded from below on [1/2,3/4]. Thus the integral in (f5"Tj) is 

bounded from below by a positive constant depending only on d and j3. By considering the cases 
when M l IP~ l K a l ^ is smaller or greater than 1, the lower bound in (|3j) follows. 

Now we come back to fixing the lower bound in the integral in ([2]). To this end it suffices to 
prove that 

(l-2m/AO«V* M l//3-l Z ,, ]V a1/M /MV/3-1 x 

^/d _ JL^V*) Al dt < 5 M (— ^ A l) , (52) 

for a sequence (5m), converging to and depending only on /?, d and Lm- When ^-^m * > 1 then 
(pi) holds as long as we take 8 > (1 - 2m/M) d l 2 . When < 1 then ([52]) holds for 

f(l-2m/M) d ' 2 

5 M > / ^(s) 1 ^- 1 ^, 



where h(s) = s 1 ^, for /3 < 1 and h(s) = s l l d — s( d_1 )/ d , for /3 > 1 (in either case h(s) 1 ^ 13 ^ 1 is 
integrable in the neighborhood of 0). 

To conclude the proof we need to give appropriate upper bounds on (R — R m )/Zo, to replace 
R m by R above. It suffices to prove that (R - R m )/Z and (R - R m )KQ /lS M 1 ' 1 ^ Z Q l converge to 
(and the convergence depends only on /?, d and (Lm))- 

If rii < uq the claim follows from the fact that R — R m < Z ni < 2Lm- We only need to check 
that Lm/Zq and LmKq^ M l ~ l l ^ Z^ 1 converge to 0. The first convergence is trivial and for the 
second calculate 

Mm J Y - L ^ ' 
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which converges to for k > 2/3 large enough. 

Now assume that no < n\. In the case Kq > M^ 1- ^/ 2 , by Lemma [2.31 and the arguments above 
we have that R — R no is asymptotically almost surely bounded by a constant (depending on (3, d 
and (Lm)) multiple of 

ktl 

^ L£ Z (l-2n/M)^ 

^ (M-2n)(l - §(1 -2n/M) d / 2 - 1 M - 2n - 1 ' 

which, after passing to the integral, can be shown to be bounded by a constant multiple of 

go L W ( M-2np ^ d/2-1 Zq m , Kg y /(i+fl 
M M \ M J ~ M M \MJ 

for M large enough. The above converges to when divided by Zq. To prove that the expression 
on the right hand side above divided by ZoM 1 /@~ 1 K converges to we need to prove that 

Lm \~m) 

converges to 0. This is true because we can assume that Kq < ML7? for k large enough. 

If Kq < M^ 1- ^! 2 then we simply need to prove that M — 2uq converges to when divided by 
either Z or ZoM 1 /^ 1 K Q 1/P . The first convergence follows trivially from the fact that Zq > M/Lm 
and M — 2tiq < MLjf, for k large enough. The second convergence boils down to showing that 

Lm { Kq ) = Lm (Ko\mm 

z mV^k 1/is z \m) 

converges to 0. Knowing that Zq > M/Lm, the inequality follows by using Kq/M < for /3 < 1 
and KqM^ > L K M for (3 > 1, when K is large enough. □ 

Now we can prove Thm. [LTI i). 

Proof of Theorem \l.l\ i). By Lemma 12.121 i n both Thm. 11.11 and Thm. 11.21 we have Xq = Q(N ai ) 

y ( m \ 

and Yq = Q(N a2 ). Since M = @(N), the condition 7 < implies that ( J is bounded from 

above by a constant, depending only on /3 and d, so the claim follows from Theorem 12.21 The case 
7 > follows by symmetry. 

□ 

To prove Thm. [TTT1 ii) and hi), we use the following result by Svante Janson (part of Theorem 
1.4 in [35]). From now on we denote the Gamma distribution with parameter m by T(m, 1), that 
is a probability distribution with the density t m ~ l e~ l T (m)~ l , where T(m) is the Gamma function. 

Theorem 2.9 (Janson). Consider the Polya urn process (S n ,Z n ) with the replacement matrix 
a 1 

where a > 0, 5 > 0, Sq > and Zq > 0. Let U ~ T(So/a, 1) and V ~ T(Zq/5, 1) be two 



5 

independent random variables with Gamma distribution and parameters Sq/ 'a and Zq/5 respectively. 
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i) If a = 5 then in distribution 



ii) If a < 5 then in distribution 



n 1 S n 



U 



u + v 



n~ a / s S v -»• aUV- a/s . 



Remark 2.5. The natural interpretation of the urn models requires Sq, Zq as well as parameters 
a, 5 to be integers. However, we can avoid this assumption by simply defining the step of the 
urn process (S n+ i, Z n+ \) = (S n + a,Z n ) with the probability S n /(S n + Z n ) and {S n+ \, Z n+ i) = 
(S n ,Z n + 5) otherwise. The process (X n ,Y n ) such that (X n+ i,Y n+ i) = (X n + a\,Y n ), with the 
probability a\X n j {a\X n + ctyYn) and (X n+ i,Y n+ i) = (X n ,Y n + 02) otherwise, can be thought of as 
an urn process in which we draw balls with different weights. It is easy to observe that the process 
(S n , Z n ) = (ctiX n ,a.2Y n ) is indeed an urn process with Sq = cxiXq, Zq = a^Y® and the replacement 
a\ai 



matrix 



0202 



Proof of Theorem \l.l\ ii). Consider the process (X nt i,Y n ,i) such that (Xq^jYq^) = (dro,dbo) and 
(X n+ i ; i,Y n+1)1 ) = (X n> i +d - 2,y n) i), with probability (3X n /(f3X n + Y n ) and (Jf„+i,i, F n +i,i) = 
(X n ^,Y n- i + d — 2) otherwise. From Theorem 1 2 . 9 1 and Remark 12 .51 we know that Xm c ,i = 0(M e ^) if 
P < 1, and Ym £ ,i = 0(M t ^) for j3 > 1. Next we show that we can couple the processes (X n , Y n ) and 
(X ni i, Y n> x) so that with probability converging to 1, as M — > 00, we have (X n ,Y n ) = (X nt i,Y nt i) 
for all < n < M e . Showing this gives that X M * = 0{M e P), Y M , = 0(M e ) if (3 < I, and 
X M , = 0(M e ), Y M e = 0(M e ^) if P > 1, which suffices to prove the claim. Then we can 
simply apply Theorem 12.21 The construction of the coupling is simple: we set (X n+ i t i,Y n+ x t i) = 
(X n> i + d — 2,l^,i) if in the configuration model the first chosen half-edge was blue and we set 
(X n +i,i, Y n+ i t i) = (X n> i,Y ni i + d — 2) if in the configuration model the first chosen half-edge was 
red. Then we have that (X n ,Y n ) = (X nt i,Y nt i) if for all k < n, the kth step in the configuration 
model was a forward step. The conditional probability that the fcth step is a backward step is 

pX k (X k - 1) + Y k (Y k -!) + (! + f3)X k Y k X k + Y k 4(d - 2) 

((3X k + Y k )(X k + Y k + Z k -l) ~ X k + Y k + Z k ~ Mi- " 

Here we used the fact that X n + Y n can increase by at most d — 2 in each step and that 2M € < M/2 
for M large enough. Now the probability that the M e first steps are forward is bounded from below 

by 

M 1_e ' 

which converges to when e < 1/2. Thus for e < 1/2 with the probability converging to 1 we have 
(X n ,Y n ) = (X Hi i,Y ni i) which as discussed above proves the claim. □ 

For the proof of Theorem 11.11 hi) we need the following lemma. 

Lemma 2.10. Let Lm be a sequence converging to 00 such that limj\//-s>oo LmM ~ 7 = for some 
< 7 < 1. Fix a positive integer Xq and for every M let Yq > Lm and assume that (L' M ) is a 
sequence converging to 00 such that L^ < YqL'^ 13 < M/logM and YqL m < M/logM for all M. 
Define the stopping time r as the first k such that X k > XqL' m or Y k > YqL' m . Then the sequence 
of random variables Yr X T Y Q ~^ is tight, as M — )• 00. 
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First we show how to use the above lemma to prove Theorem 11.11 iii). 

Proof of Theorem{Tl\iii). Apply Lemma ET0] with L M = M a2 /d and X Q = dB Q and L' M = M £ , 
where e satisfies e + «2 < 1 and e(/3 — 1) < o^- Then with the stopping time r defined as in 
Lemma 12.101 we have that Yf ' X T Y ~^ is tight, which in particular implies that with probability 
converging to 1 we have X T > M e ^/ 2 and Y T > M a2+e / 2 . Since t is a stopping time, by Strong 
Markov property we can apply Theorem 12.21 to finish the proof. □ 



To prove Lemma 12.101 we need the following corollary of Theorem | 

Corollary 2.11. Consider the Polya urn process (S n ,Z n ) with the replacement matrix ( ^ ^ 

where a > 0, 5 > 0. Let (Lm) and (L' M ) be two sequences converging to 00, let So > be fixed 
and let Zq > Lm- Define the stopping time r as the smallest integer k such that Sk/So > L M or 
Zk/Zo > L' M . Then 

Z T 

in distribution, as M — >• 00. The convergence depends on the sequences (Lm), (L' m ), the value of 
So and the parameters a and 5. 

Proof. Define U and V as T(So/a, 1) and T(Zo/5, 1) distributed independent random variables. 
Furthermore given the values of S T and Z T take U' and V to be T(S T /a, 1) and T(Z T /5, 1) dis- 
tributed independent random variables. Recall that the Gamma distribution T(m, 1) has mean and 
variance equal to m which by Chebyshev inequality implies that for any e the probability that a 
r(m, 1) random variable is in the interval ((1 — e)m, (1 + e)m) converges to 1, as m — > 00. Since 
Z T > Zq > Lm, this is true for both V and V (m = Zq/5 and m = Z T /5, respectively), implying 
there is a sequence pM,e (depending only on (Lm)) such that Huim^oo Pm,e = 0, and 

P((l - e/2)Z < V < (1 + e/2)Z ) > 1 - p M ,e (53) 

and 

P((l - e/2)Z T < V < (1 + e/2)Z T ) > 1 - p M>e . (54) 
Next we show that for any e > there is a sequence (Am, £ ) converging to such that 



U' . . x 
<(l + e)- 



yia/6 — v ; 7 a/6 

Z 



<-^7T 1 >l~\M,e (55) 



and 

U' 



> (1 



y'a/8 — v I 7 a/8 

Z 



ryCt/S — r^Ct/S 



S? ) >1"Am, £ . (56) 



7 a/8 — ryCe/5 
Zj t Z/q 



If S T > L' M /2 then ([55}, ® follow from ([MD and the analogous bound for U' . If S T < L' M /2 

then we have Z T > ZqL m and we only need to prove (|55p . since S T Z T a ^ S < Z a ^L' M a ^ 2 . This 
inequality follows from the fact that we either have V < (1 — e)Z T , or U' > (l + e)(l-e) a ' 5 L>£. The 
first event has probability bounded from above by pm,e and the second one, by Markov inequality, 
has probability at most (1 + e)~ 1 (l — e)~ a / s L A ^ 2 . 
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If a < 5 then, by Theorem l2.9l conditionally on J> the random variable (n — r) _a//<5 S n converges 
in distribution to aU'V'^ a ^ , as n — > oo and other parameters stay fixed. Since r is less than 
SoL'^/a + ZqL'^/5, which doesn't depend on n, this is also true when (n — T)~ a / s S n is replaced 
by n~ a / s S n . For fixed M and n large enough, (f55j) . (j56j) now implies 

P (J** ^) * 0- - 2Am,)- 1 P < «(1 + • 

Again, by Theorem 12,91 the probability on the right hand side above converges 

(1 + e)xZ a/5 ^j which in turn is bounded by F(U < (1 + e)(l + e/2) a / s x) + p M>e . Taking M -> oo 
we obtain that 

x/S $T 
M^oo V J Zr' 



limsupP [ Zq /0 ^^ <x\ < F(U < (1 + e)(l + e/2) Q / 5 x) 



and as e > was arbitrary we obtain the upper bound on p{z* /S ^ < x). Using ([56]) we can 

obtain the upper bound on p(^Zq^ S — x ) i n the same way which proves the claim when a < 5. 

By using the same arguments as in the previous case, for 5 < a, conditionally on T T the random 
variable n~ s ^ a Z n converges in distribution to 5V'U'~ s ^ a and thus for a fixed M and n large enough 
we have 

SV <"L) <(l-2X M ,er 1 Hn-^Z n >6(l + er s ^). 



Z a/S - z a/8 J - ^ ~"M,ej - ~n _ i w 

The probability on the right hand side above converges to f(yU- 5 / a > (l + e)~ 5 / a Z x- 5 / a ^J which 

in turn is bounded by ¥(U < (1 + e) l+a ^x) + pM,e- Taking M — > oo and e — > proves one bound 
in this case. As before the other bound is proven in the same way. 

For the case a = S observe that S T /Z T < x/Zq and S T /Z T > x/Zq are equivalent to S T /(S T + 
Z T ) < x/(x + Zq) and S T /(S T + Z T ) >x/(x + Zq) respectively, and argue as before. □ 

Now we prove Lemma 12.101 

Proof of Lemma \2. 1 (A Define the stopping time a = rA(M/4— 1). Consider the process (X' n ,Y n , Z' n ) 
which corresponds to (X n ,Y n , Z n ) with disregarded connections between blue and red half-edges, 
and between red half-edge. More precisely let (Xq,Yq, Zq) = (Xq, Yq, Zq) and 

( x 'n+\ , Y n+i , z n+i) = ( x 'n + d ~ 2 > Y n, Z n ~ d ) > with probability 



PX n + Y n 

Y Z, 

(X' n+1 , Y n+1 , Z' n+1 ) = (X'n, Y' n + d - 2, Z' n - d), with probability 



(X' Y' Z') = (X' n , Y n - 2, Z' n ), with probability 



(px n + Y n )(x n + Y n + z n -iy 

Y n (X n + Y n — 1) 



(pX n + Y n ){X n + Y n + Z n -l) 



We can couple the processes (X n ,Y n , Z n ) and (X' n ,Y n , Z' n ) so that X' n+1 = X' n + d — 2 if a 
blue half-edge is chosen in the first part of the step of the (X n ,Y n ) process, Y n+1 = Y n + d — 2 if 
Y n+ \ = Y n + d — 2 and Y n=1 = Y' n — 2 if a red half-edge is chosen in the first part of the step of the 
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(X n ,Y n ) process and Y n+1 < Y n . This coupling gives us (X k ,Y k ,Z' k ) = (X k ,Y k ,Z k ), if Xt+i > X e 
for all I < k. Given k < a the conditional probability that X k+ \ < X k is equal to 

f3X k (X k - 1) + (1 + (3)X k Y k ^ (2 + (3)X k ^ ^X L% 



< „ . ' „ < 2- 



((3X k + Y k )(X k + Y k + Z k -l) ~ X k + Y k + Z k -1 ~ M ' 

By a simple union bound it follows that the probability that X k+ i > X k for all k < 2(XqL^ + 
Yo-^m) A <t converges to 1. Since by the urn result in Theorem 14.11 with probability converging to 
1 we have that r < 2(X L'^ + Y L' M ) < M/4 - 1, we conclude that we can couple the processes 
(X n ,Y n , Z n ) and (X' n ,Y^, Z' n ) so that (X k , Y k ,Z k ) = (X' k ,Y k , Z' k ) for all k < t, with probability con- 
verging to 1. Therefore in the rest of the proof we replace the process (X n , Y n , Z n ) by (X' n , Y^,Z n ) 
and r by r' which is the first time k that X' k > L 1 ^ or Y k > YqL' m . Clearly we have r = r' with 
probability converging to 1 as M — > oo. Also set a 1 = t' A (M/4 — 1). 

Next construct the process (X Hj i, Y n> i) so that (X ni i,Y n> i) = (Xq, Yq) and (X n> i,Y n> x) = (X n> i + 
d—2,Y Ut i) with the probability f3X nt i/((3X n< i+Y n ^) and (X nj i,Y n ^i) = (X Ut i, Y n j_+d— 2) otherwise. 
For e > construct the process {X n 2,Y n 2) with the same transition probabilities and such that 
(-Xo,2> ^o,2 ) = (Xo, (1 ~~ e )^o)- Observe that we can couple the processes (X' n ,Y£) and (X nt i,Y n> i) 
so that X' n > X n i and Y£ < Y n i, for all n. Furthermore for all k such that Y k ^ < Y7, whenever 
= + d — 2 we can set = -^fc,2 + d — 2. Using this coupling we have that X' k < X k 2 

and Y' k > Y k ^. for all < k < k, where n is the first time k such that Y' k < Yfc,2- Clearly if k < cr' 
then there are at least edY® indices k < a' such that Y k+1 =Y k — 2. Given k < a 1 the conditional 
probability that Y k+1 = Y k — 2 is equal to 

m' - 1) < n < 2 y o l 'm 



The expected number of indices < k < 2{XqL ! ^ + YqL' m ) A a' such that , 1 = Y k — 2 is therefore 
bounded by 



2(X Lf 1 +Y L' M ) y2r ,2 

M ~ M 



fc=0 

By Markov inequality the probability that the number of such indices is at least edYo converges to 
0. Since r' = r with probability converging to 1 we have that r' < 2{X Lf I + Y L' M ) < M/4 - 1 
with the probability converging to 1, as M — > oo. This implies that we can couple the processes 
(X' n , Y£) and {X n ^^ Y Tl ^) so that with probability converging to 1 we have X' n < X n ^ and Y^ > Y n ^, 
for all n < t' . 

Define t\ (t^) as the first time k that Xk,i > XqL'^ or Y k ^ > YqL' m (X kt \ > XqL'^ or 
Yk,2 > (1 — £ )^o-^m)- From Corollary 1 2 . 1 1 1 and Remark 12.51 we have that, when Xq is fixed 

y/^->iW(d-2),i) 

and 

(l-«W^f->W(d-2),l). 
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For a sufficiently large C, if YqX' t Yt~^ < C _1 then we necessarily have Y' T > YqL' m and X' T < l/f^, 
which implies that T\ < r, Y Tlj % > YqL' m and X ri) i < X T > i < X' T ,. Since Y T1> \ and Y^/ can only 
differ by a constant we see that 

limsupPflf < C~ l ) < limsupPfy ^^^ < C' 1 ) = F(T(X /(d - 2), 1) < C' 1 ). 

A/^oo V Y , P ' M->-oo V K i ' 

T Tl , 1 

The bound on P^Y^^E^- > can be proven in the same way by comparison with process 
(X n>2 ,Y n . 2 ). □ 

Finally, to prove Thm. [L~2"l it is enough to show that there is a constant c such that in the setting 
of Thm. I1.2| with high probability the initial number of blue half-edges is (1 + o(1))cBq. This is 
obvious when Bq is a constant, so all that is left to prove is that when Bq = N ai it is also true. 

Lemma 2.12. Let G ~ Q(N,d), and B be a random subset of k blue vertices ofG, where k < N ai . 
Then there exists an e > such that if B starts spreading with rate f3 until there are N ai blue 
vertices, then the number of active edges (i.e. edges whose clocks have started ticking but haven't 
fired yet) is (1 ± o(l))(d — 2)N ai with probability at least 1 — O(-^f). 

Proof. Again, we use the configuration model for d-regular graphs on N vertices. Using the same 
notation used before, let the initial number of blue vertices be Bq = k, and Xq = dk be the initial 
number of blue half-edges. Define L n to be the number of backward steps by time re, i.e. the 
number of steps where both half-edges chosen are colored. The transition rule for L n is 

{ T -, dk+(d-2)n~dL n -l 

L n W.p. 1 V-2n-l 
T . -| dk+(d-2)n-dL n -l 

Ln + 1 W.p. U-2n-l 



By this rule we have the recursion 

EL n+1 = (1 - dN - d 2 n-l) EL ™ + dk dN-2n-l 1 



which gives 



n n , 7 \ 

= E dj m^ n (i - s^jn) ■ (w) 



i=0 .7=1+1 

Let us approximate this expression. First, look at the product. 



j=i+i 
and 



TT ( i d ) < e - d ^U +1 iw^j-i 

J- -I- I dN-2j - 1J ~ 



d E ffilH * d I dN -2x-l dX = -2 dHdN ~ 2x ~ 1] 



j=i+i 



1 ( dN - 2i - 1 
-din 



2 \dN-2n-l 
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Plugging this expression back into (f5T|) . we get 



n l 
WJ , \ dk+(d-2)i-l ( dN-2n-l \~^d 

^n+l ^ dN-2i-\ \ dN-2i-l ) 



i=l 



/•n+1 

< (dN-2n-l)2 d I J^t^±-dx 



(dN-2x-l)? c 



(x + k- N) 



' dN-2n-V 
,dN-2x-l, 



l. 



n+1 



= {n + l + k-N)(^E^)^ + (N-k)(^i)^ 

= (n + l + k-N)(l + 0(^)) + (N-k)(l- 1 $t- 1 +0(&)) 

< 0(^)+0(f)+0(A) . 

For every n < N ai we have EL n+ i < 0(N 2ai ~ 1 ^) . The number of vertices added by step n 
is k + n — L n , therefore, by Markov's Inequality the step when there are N ai vertices is with 
probability at least 1 - O(^), between N ai and N ai -k + N 2ai - 1+£ for some e > 0. 

The number of active half-edges at step n is dk + (d— 2)n — dL n , and therefore with probability 
at least 1 — O(-^f), the number of active half-edges at the step when there are iV ai vertices is at 
least dk + {d — 2)N ai — 7\r 2a i- 1 + £ . Since a\ < 1 implies that 2a\ — 1 < a\, we can choose e so that 
jy2ai-i+£ _ (jy ai ), w hich concludes our proof. □ 



3 The d dimensional torus 

As mentioned in the introduction, the behavior of the competing infection process is extremely 
different when the underlying graph is a d dimensional torus, and not a random d-regular graph. 
The difference is stated in Thm. 11.31 which is proved in this section. The proof relies on the 
following shape theorem from [14] . due to Cox and Durrett. 

Theorem 3.1 (Cox, Durrett). For any distribution F there exists a convex set A such that for any 

P((l - 5)tA c & C (1 + 5)tA) -> 1 

as t — > oo, and where £t = {x 6 1? : d(0,x) < i} ; and d(0,x) is the minimum weight path from 
to x with edge weights distributed independently according to F. 

This theorem was generalized for every d > 3, see for example |39j . 

Proof of Thm. 11.31 By Thm. 13. 1\ and since |£>o| = £ N, there exist a > and a convex set A (A 
is the convex set associated with the exponential distribution with rate (3) such that with high 
probability Bq obtained in Thm. [L3l contains (1 — 5)anA and is contained in (1 + 5)anA for some 
small 5 > 0. 

Denote the first point in Bq by v, and the point in IZo by u. Let both processes continue 
spreading for some small time a'n. At that point, with high probability the blue set is contained 
in the convex set (1 + 5)(a + a')nA, and the red set is contained in the convex set (1 + 5)a'nA' , 
where A' is the convex set associated with the exponential distribution with rate 1. We can choose 
a' small enough so that the sets (1 + 5)(a + a')nA centered at v and (1 + 5)a'nA' centered at u 
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are disjoint. Since at this time, with high probability the red set is contained in the convex set 
(1 — 5)a'nA', which contains Q(N) vertices, the final number of red vertices is also linear. 

□ 

It is interesting to notice what happens when both vertices start with only one vertex, the blue 
vertex spreads with rate /3, and the red vertex spreads with rate 1. Without loss of generality we 
can assume that the blue vertex v is at the center of the torus, and denote the red vertex u by 
u = v + (xi, . . . , Xd)n, where X\, . . . , Xd € [—5,5]- Denote, as before, the convex set associated with 
the exponential distribution with rate f3 by A, and the convex set associated with the exponential 
distribution with rate 1 by A'. We can think of A, A' as unit balls of the metrics d, d' respectively, 
where d(v,w) = {mint\w £ tA} and d'{u,w) = {mint\w £ tA'}. Then with high probability, the 
final blue and red sets will be determined by the Voronoi partition of the torus, i.e., every point 
w such that d(v,w) < d'(u,w) will be colored blue, and every point w such that d'(u,w) < d(v,w) 
will be colored red. 

4 Urn Result 

Finally we discuss the urn result we used extensively. The urn model discussed here is finite, i.e., 
its matrix has negative eigenvalues, which means that eventually there will be no balls left in the 
urn. The next theorem defines the urn model, and provides a concentration result for the values of 
S n ,Z n throughout the process. 

Theorem 4.1. Assume < a < b are positive integers. Let S n and Z n be the number of balls in 
the urn process with scheme ^ ^ ^ ^ ^ and let M = So + Zq. Denote the processes 

K n = — — rri-, and L n = 



— an) — Zq(1 — an/M) b / a ' 

and the stopping time ctz ,m as the smallest integer n such that Z n = 0. For fixed positive e < 1/2 
and t define nij = [M(l — tZ a ^ b )/a\ and n2,t = [M(l — t~ 1 Z Q a ^ b )/a\ and consider the event 

K-z ,M,t,e = {\K n - 1| < e, for allO <n< ra M }. 

Then 

a) There exists a universal constant C (not depending on Zq, M , e and t) such that 

C (~<v a / b 
n^z ,M,t,e) > 1 - for all t > (58) 

and 

n°z»,M > n 2 , t ) < tb ° b _ a) , for all t > 1. (59) 

b) For any e > there is a positive sequence {\ £ ,m)m converging to such that for all < Zq < 
M 

P(|£n - 1| < e, for all0<n< M/a) > 1 - A e , M - 
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Proof, a) The condition on t in (|58p ensures that when C is large enough, we have M — an\t > 
2a + 26, so we assume this condition throughout the proof of (|58p . Define the stopping time r as 
the first time n such that Z n < 2a + 26 and iT^ = K nAT . First observe that ifg = 1 and that 
Z n + S n = M — an. Denote by T n the a-algebra generated by the first n draws. It is easy to check 
that 

W(K' — K' \ T \ = ( — — ^ n I 1 

' " +1 VZofl- 2 ^)"" Z„(l-f)V« z„(l-2^S)»/«(M-an)^ T> " 

2 ''l + ir4rrf(l-Al-lW <») 



Z (1-^)V»^V M-an-aJ V M - an 

Take a constant Ci (which depends on a and 6 only) such that for any n satisfying M — an > 2a + 26 
we have 



6/o 

1 + ^- ) -1 



M — an — a J M — an — a 

which after plugging in ([60]) gives 



< c ' 



(M -an- a) 2 ' 



\HK + i - K\r*)\ < - - %^77- f „ * , - tA- + ' 1 



2 (l_M^li)V«vM-an-a M - an (M-an-a) 2 )' 
This implies that for some constant Ci = C^a, 6) and any n satisfying M — an > 2a + 26 we have 



Furthermore we have 

E(« +1 -0 2 |Jn) < 



|E« +1 - K' n \F n )\ < K ° 2 (61) 

(M — any 



Z n Ar Z n/ \ T 



Zo (l - <nAr)+a )b/a Zq(1 _ a(nAr) )fe/a 

b \ 2 Z nAr 



+ 



Zp(l a ( nAT )+ a )fr,/a/ M-o(jlAr) 



6/a \ 2 



< 2K' r ?(((l + ^ A—, )' -1) + 



M-a{nf\r)-aJ ) Z nAr (M - a(n A r)) 

Using the same arguments as before and that Z^ < M — ak, we have that there is a constant 
C*3 = C3(°; 6) such that whenever M — an > 2a + 26 we have 

m<+l - K?\Fn) < K'* ^ < K——/ — — . (62) 

Z nAr (M — a[n At)) Z (M — an) b ' a+1 

Define p n = (M ^ n) ^ , = IliUC 1 for £ < k and %+i jfc = 1 and r n = Zo( ^ )t ° /a+1 ■ Since 

H,k < exp f X^LePi) we see that t nere is a constant C4 such that qn^ < C4 for any I and fc. Then 
we have 

< r C 3 M»/« 1 C7 5 M»/» C 5 

r*g ,fc-i - °4 Zq ( M - akf/^+i ~ Z (M - a(n lt - l)) b l a ~ ' 
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Defining Iq = K' = 1 and I n = K' n — ^fc=o ^C^-fc+i ~~ ^-fcl^fc)) as m Lemma [2T61 we have that 

E ((v, - 1) 2 ) < % 

and by a Doob's maximal theorem we have that for any 5 > 

-2^/ m „„ it r |2\ ^ 2C 5 



max |J n -1\>8)< 5~ Z E( max |I n - < 



0<n<n lit 0<n<m,t t b / a S 2 ' 

Next note that for any < n < ni^ we have 

n-l ni,t-l „ „ „ _ a/6 
O4U2 O6 ^6^0 



p k q k +i,n-i s 2^ (M _ an)2 — TV/ — o(m t - 1) s Mt ■ 

k=0 k=0 V ' K > l ' 

Conditioned on the event that \I n — 1| < S, for all < n < n\f by Lemma 12.61 we have for all 
< n < m t t that 

n-l p r?a/b 

\K' n -l\<S+(l + *) J> fc g fc+ i,«-i <S + (1 + S)-^-. 

k=0 

cz a ^ b 

Denoting the right hand side above by e and taking t > ^ for sufficiently large C we get 5 > e/2. 
Thus with probability of at least 1 — t f/^ 2 we have that \K' n — 1| < e for all < n < n\ t . Now the 
claim in (USD is trivial if t h / a < Ce~ 2 . Surely by increasing C if necessary we can conclude that for 
any e < 1/2 and t b ^ a > Ce~ 2 we have 2(a + b)t~ h l a < 1 — e. Since assuming r < n% t implies 



2(q + 6) 2(q + fe) 

K_ < 77- < T7 < t 

T — / \ b/a — +b a 

^(l- f) 



we conclude that the condition that \K' n — 1| < e for all < n < rti t implies r > nx,t and thus also 
K' n = K n for all < n < nij. Thus 

P(K Zo ,M,t, e ) > 1 ^ 



t b/a £ 2 ' 



for C large enough, which proves the inequality in (158h , 

To prove that P(az ,M > n 2,t) < t b/(^-°) ' ^ rs ^ observe that the proportion of Z-type balls 
Z n /(M — an) is a supermartingale if M — an > a. To check this calculate 



e( Zn+1 



>M-a(n + l) 



Z n Z n b Z n Z n 



M -an M — a(n + 1) M -a(n + l)M -an M - an 
(b - a)Z n 



(M - an)(M - a(n + 1)) ' 

This implies that for n\ < n2,t we have 



HZ n2t \T ni ) < M aU2 ^ (Z ni \F ni ). (63) 
ivi — an\ 
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Next define s = W( 2fe " a ) and ni = n i,s- Note that by (|58p . we see that conditioned on the event 



k z ,m,s,i/2 w e have 



E(Z m JK ZM/2 ) < !(l-^)(l-!£.y'- 1 * < §rV>~ < |rW»-). (64) 



M J \ M ) - 2 - 2 

Since s > 1 > 2CZo /b Af- 1 for M large enough, by ([58]) we have P(K| 0jMiSj1/2 ) < ^ and (JS 
with Markov inequality imply 

nz nxt > 0) < E(Z n2it |K ZoiMiS , 1/2 ) + P(K| 0iM)Sil/2 ) < jj^-y 

for large enough C, which proves (|59p (note that the proof works if M — an>2t > a > which is 
something we can assume since the last drawn ball can not be of Z-type). 
b) We start by writing 

(M - an) - Z n 



L, 



from where we easily get 



(M-an)-Z (l-^ J ' " 



b/a 

Z o(l-ff) ~Z n |if n -l| M 

Ln " 1 = / TO' and \L -1\ = ~S TO=T~ L (65) 

(M-an)-Zo(l-%) lLn 11 Zo(l-ffl 



First consider all n such that 



logM an ( M y/(b-a) 

-^^-m^KWJ ■ (66) 

From the second relation in ([65]) it is easy to check that the event Kz 0i M,iogA/,e implies that 
\L n — 1| < £ for all n satisfying (|66p . For a given e > choose M large enough so that logM > 
> Then by (pj) we have that 

P(|L n - 1| < e, for all n satisfying ©) > 1 - ^ (67) 

(log M) b ' a E 2 

Recall the definition of n\ t t from the statement. Now conditioned on the event K-z ,M,\ogM,e/2 
we have that 

Z ni , loeM < (l + e/2)2b(l - ^i^) b/a < (1 + e /2)(logM)*/ fl . 
Thus, conditioned on K ZojM) i ogMje/ / 2 ! we have that for all n satisfying 

1 an log M 
< 1 < 



Z a/b logM " M ~ z a Q /b ' 



holds < Z n < (1 + e/2)(logM) b / a , and from the first relation in (165p we get 



(l + g/2)(logM) fe / Q < _ 1 < (logMff" 

- (log M)Va - " - —^jM — - (log M)V« ' 
5 log M Zq ' log M 
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Since the denominator of both the left and the right hand side above is bounded from below by 
Af 1-0/6/ i g m - {\ogM) b / a , we conclude that for any e > with probability converging to 1 we 
have that \L n — 1| < e, for all n satisfying (|68p . 
Next consider n such that 

an 1 , 

0<1-tt< — 7i • 69 

M- Z a J b \ogM 

By ([59|) , with probability of at least 1 — ( logM j&/(26-a) we have that Z n = and S n = M — an for 
all n satisfying fj69f> . Therefore, with probability converging to 1, for all such n, we have that 

1 1 1 
1 < L n = - - T7 - T < < 



1 M ^ M / 1 ^/(logAf) 6 / 11 - 1 

The above arguments show that for a fixed e > with probability converging to 1 (uniformly in 
Z ) as M ^ oo, we have that \L n - 1| < e for all n such that < 1 - ^ < (M/2Z ) a/ ^ a) . If 
Zq < M/2 there is nothing left to prove, so assume Zq > M/2. 
Now consider the case when 

M \<»/M an logM 

<!- — <! (70) 



>2Z / " M - 

By the second relation in (|65|) the condition that 



l^'^KI.-f)* 1 -.) (71) 

holds for all n satisfying (170p . implies that \L n — 1| < e for all n satisfying (170p . To calculate the 
probability of (|7ip holding for all n satisfying (|70p . we can apply d58D with t = Z (M/2) a /( fc - a ) . 

cz a ^ b 

This application is justified by the fact that t satisfies the condition t > ^ for e fixed and M 
large enough, and the fact that the right hand side of (fTTj) is bounded from below by e/2. Thus we 
get 

2b/(b-a)(j 

W(\L n - 1| < e for all n satisfying ([70])) > 1 



Z 6/a MV(^a) e 2('MZ - 1 (l - r'^ 1 - I'' 



-6/a+l \ 2 
- 1 



> 1 (79) 

(6-a) 2 e 2 (logM) 2 M b2 /(^-a))-i' k ; 

where in the last line we used the inequality (1 — x)~ 7 > 1 + jx, for all 7 > and < x < 1, with 
7 = b/a and a; = log M/\[M~. 

Since the right hand side of (|72p converges to 1, we are left to consider the case when < n < 
(VMlogM)/a. To this end write 

<? 

L n = 
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Consider the case when S > \/M(logM) 2 and so Sq(1 - e/2) < S n < S (l + e/2), for M large 
enough and all n such that < n < (\/M log M)/a. Furthermore, for such n the denominator 
satisfies 

logM\ b /°_ / an\ / ( an\ b / a - 1 / / an\ b / a - 1 \\ 

M^mXM 1 "*) +m ( 1 "( 1 "m) )) 

<S + Af<^<S + ^v/MlogAf, 
M a 

and so it is bounded by So (1 — e/2) from below and by So(l + e/2) from above, for M large enough. 
This now implies the deterministic fact that \L n — 1| < e for all < n < (\^M log M)/a. 

We are left to consider So < \/~M (log M) 2 , so from now on we assume this. The last two cases 
we consider are 

< n < ^/(logM) 3 , (73) 

and 

\/M/(logM) 3 < n < (VM log M)/a. (74) 

Clearly for M large enough and all n satisfying ([73]) or El we have S n < 2VM(logM) 2 . Thus the 
probability of drawing an S'-type ball at the nth step for n satisfying (I73|) is bounded from above by 
3(log M) 2 j\[M and the expectation of the total number of S'-type balls drawn in this time interval 
is less than 3/logM. By Markov inequality, with probability converging to 1, in this time interval 
we will draw only Z-type balls which implies that with probability converging to 1 as M — > oo we 
have for all n satisfying (|73l) 

So + (b — a)n 



Li, 



l-lS)(So(l-ft) b/a ~ 1 +M(l-(l-^ b ' , ~ l 



For M large enough and for all n satisfying (j73|) or (|74|) we have 

1 / an\ b / a 1 , (b — a)n / / an\ b / a - 1 \ (b 
-^r < (l--rr) <z -, and ^ >—<m[\- 1-— < V 



a)n 



l + e/2-\ MJ -l-e/2' l + e/2 ~ \ \ MJ )~ 1 - e/2 
The last inequality follows from the fact that 



(75) 



/ an\ b /a-i (b 



a)n 



MJ M 



C'n 2 C log M 
~ a(b-a)M {b - a)n > 



for some constant C > 0. From (|T5|) it is clear that |L n — 1| < e for all n satisfying (|73[) . 

Using similar arguments as above we see that the expected number of S'-type balls drawn for 
ns satisfying (j74|) is no more than 3 (log M) 3 for large M. Thus with high probability we have 

S + (b - a)n - (log M) 4 < S n < S + (b - a)n. 

The upper bound on L n — 1 follows from the arguments above and for the lower bound we only 
need to modify the second inequality in ([75]) as 

(b — a)n — (logM) 4 / _ / m\W^\ < (6 - a)n - (log M) 4 
l + e/2 - \ V Af/ / l-e/2 

which holds for M large enough and all n satisfying (|74p. 

□ 
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